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Abstract 

In an earlier paper the authors proved that limits of convergent graph sequences can be 
described by various structures, including certain 2- variable real functions called graphons, 
random graph models satisfying certain consistency conditions, and normalized, multiplica- 
tive and reflection positive graph parameters. In this paper we show that each of these 
structures has a related, relaxed version, which are also equivalent. Using this, we describe 
a further structure equivalent to graph limits, namely probability measures on countable 
graphs that are ergodic with respect to the group of permutations of the nodes. 

As an application, we prove an analogue of the Positivstellensatz for graphs: We show 
that every linear inequality between subgraph densities that holds asymptotically for all 
graphs has a formal proof in the following sense: it can be approximated arbitrarily well 
by another valid inequality that is a "sum of squares" in the algebra of partially labeled 
graphs. 
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1 Introduction 



In an earlier paper the authors proved that limits of convergent graph sequences can be described 
by various structures, including 2-variable symmetric, measurable functions [0, l] 2 — > [0, 1], ran- 
dom graph models satisfying a "consistency" and a "locality" condition, and normalized, multi- 
plicative and reflection positive graph parameters (see Theorem 13.11 and Proposition 13. 3p . 

In this paper we show that each of these structures has a related, relaxed version: We can drop 
the multiplicativity condition on the graph parameter, replacing it with the simple condition that 
deleting isolated nodes does not change the value of the parameter. We can drop the "locality" 
condition on the random graph model. We can replace the graphon by a probability distribution 
of the graphon. As the first main result of this paper, we prove that these relaxed versions are 
also equivalent. 

This result will be used in adding a further equivalent structure to the list of structures 
describing graph limits: a probability measure on countable graphs that is ergodic with respect 
to the group of permutations of the nodes. 

As an application, we prove an analogue of the Positivstellensatz for graphs. Many fun- 
damental theorems in extremal graph theory can be expressed as linear inequalities between 
subgraph densities. For example, the Mantel- Turan Theorem is implied by the linear inequality 
that the density of triangles is always at least the edge-density minus i. (To be more precise, 
using "homomorphism densities" to be defined in Section [2 we get inequalities that hold true 
for all graphs; in terms of subgraph densities, we get in general only asymptotic results with 
some error terms.) 

It has been observed long ago that most of these extremal results seem to follow by one of more 
tricky applications of the Cauchy-Schwartz inequality. We confirm this in the following sense: we 
show that every linear inequality between homomorphism densities that holds for all graphs can 
be derived, up to an arbitrarily small error term, by the Cauchy-Schwartz Inequality. To make 
the last phrase precise, we use graph algebras introduced by Freedman, Lovasz and Schrijver in 
[BJ. The square of an algebra element, when expanded, yields a valid linear inequality between 
homomorphism densities. Sums of such inequalities yield further valid linear inequalities, and 
our result says that such sums of squares are dense among all valid linear inequalities. 

2 Preliminaries 

2.1 Homomorphism densities and limits 

In this paper, all graphs are simple. If we don't quantify, we also mean that the graph is finite. 

For two graphs F and G, we write F = G if they are isomorphic, and F ~ G if they become 
isomorphic after their isolated nodes are deleted. So the graph U n consisting of n isolated nodes 
satisfies U n ~ K = Uq- 

For two graphs F and G, let hom(F, G) denote the number of homomorphisms (adjacency- 
preserving maps) from F to G, and inj(_F, G), the number of injective homomorphisms from F 
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to G. We consider the homomorphism densities 

hom(F, G) 



t(F,G) = 



\V{G)\\ v ( p )\ 
and subgraph densities 

inj(F,G) 



tinj(F,G) 



inj ^ ' ~> \V(G)\ ■ (\V(G)\ - 1) • • • (\V(G)\ - \V(F)\ + 1) ■ 

Let Wo denote the set of symmetric measurable functions W : [0, l] 2 — > [0, 1]. A graphon is 
any function in Wo- For every graph F and graphon W, we define the density of F in W by 



ijeE iev 



To every graph G we can assign a graphon W^g as follows: Let V(G) = [n]. Split [0, 1] into 
n intervals Ji, . . . , J n of length A( Ji) = cti/aa- For x G J; and ye J,, let Wg(x, y) = lyeEfG)- 
With this construction, we have t(F, G) = t(F, Wq) for all finite graphs F. 

We consider on Wo the cut norm 



\\W\\u = sup / W(x,y)dxdy 

S.TCm.ll JSxT 



where the supremum is taken over all measurable subsets S and T, and the cut distance 

6 a (U,W) = w£\\U+-Wl'\\n, 

where 4>, i\> range over all measure preserving maps from [0,1] [0,1], and W^(x,y) = 
W(<fi(x), 4>{y)) [HE]. This also defines a distance between graphs by 

S D (F,G) = 5 U (W F ,W G ). 

(See [4] for more combinatorial definitions of this graph distance.) 

We note that S\j(U, W) = can hold for two different graphons: 5^{W' 1 ', W"^) = for every 
graphon W and measure preserving maps 4>,psi : [0, 1] — + [0, 1]. (It was proved in pQ that this 
gives all pairs of graphons with distance 0.) We call two graphons weakly isomorphic if their 
distance is 0. 

It was proved in [8] that (Wo, <5rj) is a compact metric space. 

A sequence of graphs (G„) with |1/(G„)| — > oo is convergent if the densities t(F, G n ) converge 
for all finite graphs F. This is clearly equivalent to saying that the subgraph densities ti n j(F, G n ) 
converge for all finite graphs F. 

It was proved in [3] that a graph sequence is convergent if and only if it is Cauchy in the Sjj 
distance. It was proved in [9] that for every convergent graph sequence there is a limit object in 
the form of a function W £ W, so that 

t{F, G n ) -> t(F, W) for all graphs F. 

In [4] it was shown that this is equivalent to Sa(Wc n ,W) — > 0. In [1] it was proved that this 
limit is uniquely determined up to weak isomorphism. 
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2.2 Partially labeled graphs and quantum graphs 

A k-labeled graph is a graph in which k of the nodes are labeled by 1, . . . , k (there may be any 
number of unlabeled nodes). A 0-labeled graph is just an unlabeled graph. Let T k denote the 
set of fc-labeled graphs (up to label-preserving isomorphism). 

A fc-labeled graph F is called flat if V(F) = [fc]. Let T' k denote the set of all flat fc-labeled 
graphs. 

Let Fi and F 2 be two fc-labeled graphs. We define the fc-labeled graph F\F 2 by taking their 
disjoint union, and then identifying nodes with the same label (if multiple edges arise, we only 
keep one copy). Clearly this multiplication is associative and commutative. For two 0-labeled 
graphs, F\F 2 is their disjoint union. 

Sometimes it is more convenient to combine fc-labeled graphs into a single structure. A 
partially labeled graph is a finite graph in which some of the nodes are labeled by distinct positive 
integers. For two partially labeled graphs F\ and F 2 , let F\F 2 denote the partially labeled graph 
obtained by taking their disjoint union, and identifying nodes with the same label. Let T* 
denote the set of partially labeled graphs (up to isomorphism). 

A quantum graph is defined as a formal linear combination of graphs with real coefficients. A 
k-labeled quantum graph is defined similarly as a formal linear combination of fc-labeled graphs. 
The product of fc-labeled graphs defined above extends to quantum graphs by distributivity: if 



2.3 Graph parameters 

A graph parameter is a real valued function defined on isomorphism types of graphs (including 
the graph Kq with no nodes and edges). Let / be any graph parameter and fix an integer fc > 0. 
We define the fc-th connection matrix of the graph parameter / as the (infinite) symmetric matrix 
M(f, fc), whose rows and columns are indexed by (isomorphism types of) fc-labeled graphs, and 
the entry in the intersection of the row corresponding to F\ and the column corresponding to F 2 
is f{F\F 2 ). The flat connection matrix Mfl at (/, fc) is the submatrix of M(f,k) formed by rows 
and columns corresponding to flat fc-labeled graphs (this matrix is finite). 

We denote by M. the space of T* x T* matrices (these are infinite matrices). For a graph 
parameter /, we define the full connection matrix as the symmetric matrix M(f) G A4, whose 
entry in the intersection of the row corresponding to F± and the column corresponding to F 2 is 
f{F\F 2 ). Clearly this matrix contains as a submatrix all connection matrices M(f, fc). In the 
other direction, we note that every finite submatrix of M(f) is contained as a submatrix in one 
of the matrices M(f, fc). 

Let / be a graph parameter. We say that / is isolate-indifferent if f(G) = f(G') whenever 
G ~ G'. The parameter is multiplicative if f(FG) = f(F)f(G), where FG denotes the disjoint 
union of the graphs F and G. 

For every graph parameter /, we define its Mobius transform p by 



/ = E"=i x i F i and 9 = EJLi VjGj, then fg = £™ =1 £™ j X^FiGj. 






F': V(F') = V(F) 
E(F')DE(F) 
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We say that / is normalized if /(-Ko) = f{Kx) = 1. Note that for a multiplicative parameter, 
it would be enough to assume f{K\) = 1, while for an isolate- indifferent parameter, it would be 
enough to assume f(Ko) = 1. Trivially, if a graph parameter is multiplicative and normalized, 
then it is isolate-indifferent. 

We call a graph parameter reflection positive if all of its connection matrices are positive 
semidefinite (this is equivalent to saying that its full connection matrix M(f) is positive semidefi- 
nite). We call it flatly reflection positive if all its flat connection matrices are positive semidefinite. 

We denote by JC the linear space of matrices A e M in which Ap Xt Gi — ^f 2 ,g 2 if FiGi = 
F2G2, and by C, the linear space of matrices A 6 M in which Af 1 ,Gi = Af 2 ,G 2 if F1G1 — F 2 G2- 
Clearly connection matrices define a bijection between matrices in JC and graph parameters. 
Under this bijection, matrices in C correspond to isolate-indifferent graph parameters. 

Let V C M. denote the cone of positive semidefinite matrices in M. . Reflection positive graph 
parameters correspond to matrices in V H JC. 

2.4 Random graph models 

A random graph model is a sequence (P n : n = 0, 1, 2, . . . ), where P„ is a probability distribution 
on graphs on [n]. Let G n be a random graph from distribution P„. We say that the random 
graph model is consistent, if the distribution P„ is invariant under relabeling nodes, and if we 
delete node n from G„, the distribution of the resulting graph is the same as the distribution of 



We say that the random graph model is local, if for every S C [n], the subgraphs of G 
induced by S and [n] \ S are independent (as random variables). 



distribution is consistent if the distribution of the labeled subgraph induced by an ordered finite 
set S depends only on the size of S. The distribution is local if for any two finite disjoint subsets 
Si? £2 C N, the subgraphs induced by Si and S2 are independent (as random variables). The 
distribution is invariant if it is invariant under permutations of N. The distribution is ergodic if 
there is no set S £ A with < tt(S) < 1 invariant under permutations of N. Invariant measures 
form a convex set in the linear space of all signed measures, and ergodic measures are the extreme 
points of this convex set. 

A probability distribution on the Borel sets of (Woj^n) will be called a random graphon 
model. Note that the cr-algebra of Borel sets does not distinguish weakly isomorphic graphons. 

3 Equivalent forms of the limit object 
3.1 Graph limits and random graph limits 

We quote the following theorem, which was proved essentially in [3] . 



G 



n-l- 
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Theorem 3.1 The following are equivalent (cryptomorphic): 

(a) A multiplicative, normalized graph parameter with nonnegative Mobius transform; 

(b) A consistent and local random graph model; 

(c) A consistent and local random countable graph model; 

(d) A graphon, up to weak isomorphism. 

(e) A point in the completion of the set of finite graphs with the cut-metric; 

The following theorem shows that in each of these objects, we can naturally relax the condi- 
tions, to get another important set of cryptomorphic structures. 

Theorem 3.2 The following are equivalent (cryptomorphic): 

(a) An isolate-indifferent, normalized graph parameter with nonnegative Mobius transform; 

(b) A consistent random graph model; 

(c) A consistent random countable graph model; 

(d) A random graphon model. 

Proof. We describe a cycle of constructions, mapping one object in the theorem to the next. 

(a)— >(b). Let / be an isolate-indifferent, reflection positive, normalized graph parameter with 
nonnegative Mobius transform. Using that / is isolate-indifferent, we get 

J2 f\F)=f{U n ) = l. 

F:V(F) = [n] 

So we can construct a random graph G„ on [n] by 

P(G„ = F) = /t(F) (V(F) = [n}). (1) 

ft is clear that this distribution does not depend on the labeling of the nodes. Let F be a graph 
on [n— 1], and let Fq be obtained from F by adding n as an isolated node. Then 

P(G n \{n} = F )= ]T P(G„ = F)= £ f\F) 

F: F\{n} = F F: F\{n}=F 

(-i) lE{F ' )HE(Fn f(F') 

F: F\{n} = F F'DF 

= f( F '^ (-i) |s(F ' )Hs(ir)| 

F'DF+ fcf' 

Here the last sum is unless F' contains no edges incident with the node n, and so f(F') = f(F"), 
where F" = F' \ {n}. Thus 

P(G n \ {n} = F )= /(F'0(-l) |E(F '' )HE(Fo)l - P(F ). 

F"DF„ 

Thus this model is consistent. We note that / can be recovered by 

f(F) = P(F C G„) (V(F) = [n]). (2) 
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(b) — >(c). Let G„ be a random graph from a consistent finite random graph model, we 
construct a countable random graph model by n(Ap) — P(G„ = F) (V(F) = [n]). This extends 
to a probability measure on the a-algebra A. It is straightforward to check that this measure is 
consistent. 

(c) — >(d). Let G be a random countable graph from a consistent countable random graph 
model, we construct a probability distribution on the Borel sets of (Wo,<fci)- Let G n be the 
finite graph spanned by the first n nodes of G. 

We claim that with probability 1, the graph sequence (G„) is convergent. Theorem 2.11 in 
[4] implies that 

<5n(G„, G m ) < 



with probability 1 — exp(— n 2 /(21ogn)). 
Let Hfc = G 2 fc , then 

p(<fa(H fe ,H fe+1 ) > il) < exp(^ rr ), 
and so by the Borel-Cantelli Lemma, 

10 

holds for all but a finite number of values of k, with probability 1. Hence with probability 1, the 
sequence (I%J is a Cauchy sequence in (Wo,<5n)- 

Now for a general value of n, let k n — [log log n\ . Then as before, we get that 

p(s a (G n ,H k J > -JL=) <cxp(— —). 
V Vl°g ns V 2 log n J 

Again by the Borel-Cantelli Lemma, 
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5 a (G n ,H kn ) < 



y/logn 

holds for all but a finite number of n, with probability 1. This proves that the sequence (G n ) is 
Cauchy. Thus it tends to a limit graphon W. 

So we have described a method to generate a random graphon W. For every graph F, this 
satisfies 

i(F,W)= lim t(F,G n )= lim i inj (F,G„). 

n — >oo n — >oo 

By the consistency of G, the expectation of U n j(F, G„) is independent of n for n > k = \V(F)\, 
and so 

E(t(F,W)) = lim E(i inj (F,G„)) = E(t inj (F, G fe )) = P(F C G fe ). 

n^oo 

(d)— >(a). Let W be a random graphon from any probability distribution on the Borel sets 
of (Wo, Sjj). This defines a graph parameter / by 

/(F) = E(t(F,W). 

For every fix W G Wo, the graph parameter /(.) = t(.,W) is normalized, isolate-indifferent 
(since it is multiplicative), and has nonnegative Mobius transform (by Theorem 13. ip . Trivially, 
these properties are inherited by the expectation. □ 
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3.2 More equivalences 

In theorems 13. II and 13. 21 we listed several seemingly quite different objects that have turned out 
equivalent. In this section we show that these objects have alternative characterizations. The 
following characterization of graph parameters occurring in Theorem 13.11 was proved in [5] . 

Proposition 3.3 Let f be a multiplicative, normalized graph parameter. Then the following are 
equivalent: 

(a) / is reflection positive; 

(b) / is flatly reflection positive; 

(c) / has nonnegative Mobius transform; 

(d) / = t(.,W), where W is a graphon. 

(e) / is the limit of homomorphism density functions. 

For graph parameters in Theorem 13.21 we have the following. 

Proposition 3.4 Let f be an isolate-indifferent, normalized graph parameter. Then the follow- 
ing are equivalent: 

(a) / is reflection positive; 

(Jo) f is flatly reflection positive; 

(c) / has nonnegative Mobius transform; 

(d) / = E(t(.,W)), where W is a random graphon. 

(e) / is in the convex hull of limits of homomorphism density functions. 

While the proof here is similar, there are some differences, and we include it for completeness. 

Proof. (a)=>(b) is trivial. 

(b) =>(c): The Lindstrom-Wilf Formula gives the following diagonalization of Mg a t(/, k): Let 
Z denote the T' k x !F' k matrix defined by Zp t p 2 = li?iCF 2 - Let D be the diagonal matrix with 
Dp p = P(F). Then Mfl at (/, k) = Z T DZ. This implies that Mfl at (/,fc) is positive semidefinite 
if and only if /' > for all graphs with k nodes. 

(c) =>(d): Let / be an isolate-indifferent, normalized graph parameter with nonnegative 
Mobius transform. By Theorem 13.21 it defines a random graphon W such that / = E(t(., W)). 

(d) =>(e): By Theorem 13.21 each £(.,W) is the limit of homomorphism density functions for 
every W. 

(e) =>(a): Every homomorphism density function / is reflection positive, and this is clearly 
inherited to their limits, and then to the convex hull of these limits. □ 

The following propositions describe connections between graph-theoretic and group-theoretic 
properties of countable random graph models. They also indicate a connection with ergodic 
theory. 
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Proposition 3.5 A countable random graph model is consistent if and only if it invariant. 

Proof. It is trivial that invariant countable random graph models are consistent. Conversely, 
if a countable random graph model is consistent, then it defines a consistent finite graph model, 
which in turn defines a unique countable random graph model, independently of the labeling of 
the nodes. □ 



Proposition 3.6 A consistent countable random graph model is local if and only if it is ergodic. 

Proof. Let /i be an invariant probability measure on the Borel sets in {0, 1}( 2 ) . By Proposition 
13.51 it is consistent, and so by Theorem 13.21 it is defined by a random graphon. If \i is ergodic, 
then /x is an extreme point of all invariant distributions, and therefore this random graphon must 
be concentrated on a single graphon. Thus Theorem 13.11 implies that is local. 

Conversely, if /i is not ergodic, then /i = \{p,\ +1*12), where /xi,/i2 are invariant probability 
measures and /ii =/= fJ-2- Let Gi and G2 be random countable graphs from the distributions fi\ and 
H2, respectively, and let G be Gi with probability 1/2 and G2 with probability 1/2. Let SCN 
be a finite set and F a labeled graph on \S\ nodes such that P(Gi[5] = F) 7^ P(G2[5] = F). Let 
TCNbe another set with \T\ = \S\ and Tn S = 0. Set a x = P(Gi[5] = F) = P(Gi[T] = F) 
(by invariance, these two probabilities are equal), and define a 2 analogously. 

Thus we have 

P(G[S] = F, G[T] = F) — P(G[5] = F)P(G[T] = F) 

= i(P(Gr[5] = F, Gi [T] = F) + P(G 2 [S] = F,G 2 [T] = F)) 

- J(P(Gi[S] =F) + P(G 2 [S] = F))(P(Gi[T] = F) + P(G 2 [T] = F)) 

= + a\) - i(oi + a 2 f = -{a x - a 2 f > 0. 

This shows that \x is not local. □ 



4 Weak Positivstellensatz for graphs 

Let x = a x Fi + - ■ -+a r F r be any quantum graph. We say that x > if t(x, W) = ^2, i a.it(Fi : W) > 
for every W E Wq. Hence x > if and only if J2i a if(Fi) — f° r every multiplicative, 
reflection positive graph parameter /. Proposition 13.41 implies that this is equivalent to saying 
that J2i a if(Fi) ^ for every isolate- indifferent, reflection positive parameter /. 

An easy example of quantum graphs x > is any quantum graph of the form ^ yf , where 
the yt are fc-labeled quantum graphs for some k > (and the labels are ignored after squaring). 

One may ask whether every quantum graph x > can be represented this way. We don't 
know the answer, although based on the analogy of polynomials, the answer is probably negative. 
However, we prove the following weaker version, which is analogous to Lasserre's result [7] 
asserting that positive polynomials are approximately sums of squares. 
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Theorem 4.1 Let x be a quantum graph. Then x > if and only if for every e > there is a 
k>l and yi, . . . ,y m € Gk such that \\x - yf - ?/, 2 n ||i < s. 

Proof. For n > k > 0, let Tk denote the set of fc-labeled simple graphs on [k] (up to 
isomorphism). Let denote the operator mapping a matrix M. to its restriction to Tk x Tk- 
Then Affc = 3>fcAl is the space of all symmetric Tk x matrices, and Vk = ^fc^ 5 is the positive 
semidefinite cone in 4>feAL It is also clear that Ck = &k£ consists of those matrices A G AJ& in 
which A Fl>Gl = A F2 ,g 2 whenever F\Gi ~ F 2 G 2 . We set 7£ fc = * fe :P n * fe £. Clearly, 



but equality may not hold in general. 

We note that the entries of every matrix A £ IZk are in [0, Ag j]. Indeed, looking at the 
2x2 submatrix formed by the rows corresponding to some fc-labeled flat graph F and the Re- 
labeled edgeless graph Uk. From A 6 <&fc£ it follows that Au kt p = A)F,F — Ap,u k , so positive 
scmidcfmiteness implies that Ajj h ,u h AF,F > A FF . Since Au k ,v h — ^0,0 by A 6 <frfc£, we get 
that (Agj — Af j f)Af,f > 0, which implies that Af,f € [0,^0,0]- 

For k < m, we consider Tk as a subset of T m , by adding m — k isolated nodes labeled 
k + 1, . . . ,m. The corresponding restriction operator on matrices we denote by *f> m ,k- 

We claim that the following weak converse of ((3]) holds: 



Indeed, let A be a matrix that is contained in the right hand side. Then for every m > k we 
have a matrix B m € lZ m such that A is a restriction of B m . Now let m — > 00; by selecting 
a subsequence, we may assume that all entries of B m tend to a limit. This limit defines a 
graph parameter /, which is normalized, isolate-indifferent and flatly reflection positive. By 
Proposition EUl / is reflection positive, and so the matrix M(f) is in V n C and 3>fcM(/) = A. 

Let x — oji-Fi + ■ ■ • + a r F r . We may assume that |y(Fi)| = fc for all i. Let F( be obtained 
from Fi by labeling all its nodes. Let A £ Affc denote the matrix 



Then x > means that A ■ Z > for all Z € ^k{V H £), in other words, A is in the dual cone of 
'f'ki'P H £). From (fJJ it follows that there are diagonal matrices A m £ such that A m — > A 
and Am ■ F > for all Y S ^ m ,kTi-m- In other words, A m ■ $ mj fcZ > for all Z G 7£ m , which can 
also be written as k A m ■ Z > 0, where fe : AJfc — > A4 m is the adjoint of the linear map 
*m,fc : AJ m — > Affc. (This adjoint acts by adding 0-s in all entries outside Tk x .Ffc.) So 4>* n fe A m 
is in the polar cone of 7^. m — Pm ^1 £m> which is T^^j -t- ^^ n - The positive semidefinite cone is 
self-polar. The linear space C* m consists of those matrices B e Af m for which p 2 B Fi ,f 2 = 0, 
where the summation extends over all pairs Fi,F2 € ^F' m for which Fii 7 ^ — F for some fixed 
graph F . Thus we have & m ^A m = P + L, where P is positive semidefinite and L e L* m . Since 



(3) 




(4) 




a,, ifF = G = Fi 
0, otherwise. 
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P is positive semidefinite, we can write it as P = X)feLi v kVk T , where Vk € M?™. We can write 
this as 

EV^ J {A m )F ,F , if FiF 2 ~ F € J-"fc, 

2_^v k!Fl v k} F 2 = < 
^— ' 1 0, otherwise. 



Fl,*2 fe=0 



In other words, 



fe=l \ F / F 



which proves the Theorem. □ 
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